English Talking Head Adaptation for Lithuanian Speech Animation

نویسندگان

  • Ingrida Mažonavičiūtė
  • Romualdas Baušys
چکیده

Visual speech animation plays an important role in human-computer interaction. To force already existing English Talking Head speech animation engine to talk Lithuanian, some modifications to the animation script were made. For this adaptation, the relation between English and Lithuanian languages was explored. To determine it, 30 3dimensional Lithuanian visemes were modeled using the calibration of two orthogonal pictures of phoneme. Using the visual similarity of different English and Lithuanian phonemes, “Lithuanian phoneme to English viseme mapping table” was defined and used for Lithuanian speech animation.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Generation of Personalized MPEG-4 compliant Talking Heads

This paper studies a new method for three-dimensional (3D) facial model adaptation and its integration into a Text-to-Speech (TTS) system. The TTS System pronounces, in real time, English or Greek speech and simultaneously animates the adapted face model, thus simulating a natural talking face. The 3D facial adaptation requires a set of two orthogonal views of the user’s face with a number of f...

متن کامل

Transforming an embodied conversational agent into an efficient talking head: from keyframe-based animation to multimodal concatenation synthesis

BACKGROUND Virtual humans have become part of our everyday life (movies, internet, and computer games). Even though they are becoming more and more realistic, their speech capabilities are, most of the time, limited and not coherent and/or not synchronous with the corresponding acoustic signal. METHODS We describe a method to convert a virtual human avatar (animated through key frames and int...

متن کامل

Evaluation of A Viseme-Driven Talking Head

This paper introduces a three-dimensional virtual head for use in speech tutoring applications. The system achieves audiovisual speech synthesis using viseme-driven animation and a coarticulation model, to automatically generate speech from text. The talking head was evaluated using a modified rhyme test for intelligibility. The audiovisual speech animation was found to give higher intelligibil...

متن کامل

A new language independent, photo-realistic talking head driven by voice only

We propose a new photo-realistic, voice driven only (i.e. no linguistic info of the voice input is needed) talking head. The core of the new talking head is a context-dependent, multilayer, Deep Neural Network (DNN), which is discriminatively trained over hundreds of hours, speaker independent speech data. The trained DNN is then used to map acoustic speech input to 9,000 tied “senone” states p...

متن کامل

MASSY speaks English: adaptation and evaluation of a talking head

This paper presents an extension of a talking head that was implemented to synthesize audiovisual speech utterances in German. A mapping of English to German phonemes and a subsequent refinement of the co-articulation model enables the system to generate English utterances. A modified rhyme test was carried out for evaluation in terms of intelligibility. Results show that the visualization incr...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2009